共查询到20条相似文献，搜索用时 15 毫秒
1.
Ruth M. Colwill 《Learning & behavior》1993,21(4):337-345
The effect of training a positive discriminative stimulus (S+ ) as a signal for the nonreinforcement of an instrumental response (S?) on the ability of that stimulus to evoke its original instrumental response was examined in three experiments using rats. In all three experiments, two different stimuli were established as S+s for different response-outcome relations. In Experiment 1, an S+ was less effective in controlling its original response after it had undergone training as an S? for a new response that earned the same outcome than it was after training as an S? for a response that earned a different outcome. Experiment 2 established that this effect was not mediated by Pavlovian inhibitory conditioning produced by the negative correlation between the S+ and the outcome during S? training. Simply arranging a negative correlation between S+ and the outcome whose occurrence it had previously signaled did not impair the ability of that S+ to elicit its original response. In Experiment 3, the response-evoking properties of an S+ were found to be undermined by using the S+ as a signal for the simple extinction of a new response trained with the same outcome, but not with a different outcome. These results suggest that positive discriminative stimuli use their associations with the outcomes earned in their presence to control the responses that earned those outcomes. 相似文献
2.
Robert A. Rescorla 《Learning & behavior》1990,18(2):206-211
In three experiments, thirsty rats were trained to make several instrumental responses whose outcomes differed in which of two relatively inconsequential flavor features they contained. In Experiment 1, one of the features was subsequently devalued by pairing it with lithium chloride; in Experiment 2, it was enhanced in value by pairing it with sucrose. In both experiments, differences in the value of the features resulted in parallel differences in the likelihood of the responses during a subsequent extinction test. In Experiment 3, the animals chose between these responses in the presence of discriminative stimuli that had signaled the occurrence of these different features following another response. The stimuli selectively augmented the likelihood of the response with which they shared training by the same-flavored consequence. These results indicate that rats can separately encode features that differ along one dimension, both in the association between an instrumental response and its outcome, and in the association between a discriminative stimulus and that outcome. 相似文献
3.
Three different techniques were employed to analyze the associative structures mediating performance on an instrumental biconditional discrimination. In all three experiments, rats were trained concurrently on two tasks in which different stimuli signaled which one of two responses would be followed by reward. In each task, one response was rewarded in one stimulus and the other response was rewarded in the other stimulus. Correct responses earned pellets in one task and sucrose in the other task. The transfer procedure was used in Experiment 1A to identify whether or not an association developed between a biconditional discriminative stimulus and its instrumental outcome. Evidence was obtained that a biconditional cue elevated preferentially a new response trained with the same outcome. Experiments 1B and 3 examined the potential contribution of this stimulus-outcome association to biconditional performance by training the biconditional cues as signals (S-s) for the nonreinforcement of a different response. There was no evidence that this operation interfered with the ability of a biconditional cue to control performance of its correct response. In Experiments 1B and 2, the value of the instrumental outcome was reduced in an attempt to assess the contribution of stimulus-response associations to performance on the biconditional discrimination. The results of Experiments 1B and 2 reveal that correct responses were depressed following devaluation of the outcome used to train them, suggesting that learning about the response-outcome relation occurs. The implications of these results for binary and hierarchical models of instrumental learning are discussed. 相似文献
4.
We conducted three experiments to investigate the associative structure underlying the reinstatement of instrumental performance
after extinction. In each experiment, rats were initially rewarded on two responses with different outcomes. At test, both
responses were extinguished in order to assess the impact of a single noncontingent outcome delivery on response selection.
Experiment 1 found evidence of outcome-selective reinstatement (i.e., more responses were performed on the lever that was
trained with the reinstating outcome than on the other lever). Experiment 2 demonstrated that the outcome’s capacity to reinstate
performance was not affected by a reduction in its motivational value. Experiment 3 found evidence that the reinstating outcome
selectively retrieved the response it signaled rather than the response it followed during training. Together, these findings
are consistent with the view that instrumental reinstatement depends on the discriminative stimulus properties of the reinstating
outcome. 相似文献
5.
Robert A. Rescorla 《Learning & behavior》1992,20(3):223-232
In three experiments with rats as subjects, instrumental training procedures were used to study the format of encoding of the reinforcing outcome (O). At issue is the relative contribution of response-outcome (R-O) associations between responses and their earned outcomes and of O-R associations between anticipated outcomes and responses reiaforced in their presence. In Experiments 1 and 2, R earned one O during a stimulus that controlled the anticipation of another O. Devaluation and transfer tests suggested that the earned O was more critical than the anticipated O in controlling behavior. In Experiment 3, a differential-outcomes procedure was used, with consistent R-0 relations arranged in groups that differed in the consistency of O-R relations. Subsequent devaluation of O produced similar selective depression of R, regardless of the O-R relations. These results suggest that an R-O association can contribute to instrumental performance more than does an O-R association. 相似文献
6.
Three experiments, using rats, demonstrated the encoding of a food unconditioned stimulus (US) in a simple Pavlovian conditioning paradigm. In all three studies, one stimulus was used to signal the delivery of pellets and a different stimulus was used to signal the delivery of sucrose. In Experiment 1, postconditioning devaluation of one of the food USs selectively reduced the frequency of conditioned magazine-directed behavior during the stimulus trained with that US. In Experiment 2, transfer of the stimuli to instrumental responses resulted in selective depression of the response trained with a different outcome. In Experiment 3, acquisition of stimulus-outcome learning was impaired by unsignaled intertrial presentations of the same outcome but not of a different outcome. These results indicate that a detailed representation of the outcome is encoded in the normal course of Pavlovian conditioning. 相似文献
7.
Two experiments assessed the degree to which Pavlovian facilitators were interchangeable with instrumental discriminative stimuli (Sds). In Experiment 1, rats were trained in a Pavlovian paradigm in which one stimulus (i.e., a facilitator) signaled the reinforcement of another stimulus (i.e., a target). Next, the rats were given instrumental discrimination training in which an Sd signaled the reinforcement of barpressing. A transfer test then assessed the capacity of the Pavlovian facilitator to promote barpressing. The results showed that the facilitator promoted significant barpressing, both when it was presented alone and when it was presented in compound with the Sd. Reliable transfer was not obtained with a “pseudofacilitator” control stimulus that, during training, was uninformative about the reinforcement of its target. Experiment 2 showed that a stimulus trained as an instrumental Sd reliably augmented responding to a stimulus previously trained as a target in a Pavlovian facilitation paradigm. A “pseudo-Sd” that, during training, was uninformative about the reinforcement of barpressing failed to promote such transfer. These results show that Pavlovian facilitators and instrumental Sds are interchangeable to a significant degree, and suggest that facilitators and Sds may act via similar mechanisms. 相似文献
8.
Little responding develops to a conditioned stimulus (CS) that is placed in a random relation to an unconditioned stimulus (US). However, if the USs not preceded by that CS are themselves signaled by another stimulus, then the CS does come to elicit responding. This result has been attributed (e.g., by Durlach, 1983) to the signal’s blocking of conditioning to background cues that otherwise would prevent conditioning of the CS. However, Goddard and Jenkins (1987) have suggested the alternative that signaling the USs promotes responding due to the adventitious creation of periods of signaled nonreinforcement. Two experiments were conducted to assess this alternative, involving an autoshaping preparation in pigeons. In Experiment 1, little responding to a keylight CS presented in a random relation to a food US occurred, despite the explicit presentation of a discrete noise signaling periods of no food in the intertrial interval (ITI). Experiment 2 was designed to replicate the procedure of Goddard and Jenkins, in which an auditory stimulus extended throughout the ITI of a random schedule, terminating only prior to extra USs and during the CS. Contrary to their findings, little responding developed to the target CS. However, responding did develop when the sound-free period occurred only prior to the extra USs. These results offer little support for the hypothesis that signaled periods of nonreinforcement promote responding on random schedules. However, they are consistent with the view that signaling of ITI USs acts by preventing conditioning of potentially competitive background cues. 相似文献
9.
Louis D. Matzel 《Learning & behavior》1985,13(2):187-193
A series of experiments used food-deprived pigeons to examine several parameters of reinforcement omission in an attempt to control changes of keypeck response measures on a subsequent schedule. In Experiments 1 and 2, the pigeons were tested with a multiple fixed-ratio schedule on which reinforcement was occasionally omitted at the completion of the first component. The duration of the delay occurring in lieu of reinforcement was systematically varied. In Experiment 3, the stimulus that signaled the second component of the schedule was altered to appear either more or less similar to the stimulus that signaled the first component. Two principal results are reported: (1) Response latency decreased and, to a much lesser extent, terminal response rate increased as the delay occurring in lieu of reinforcement decreased; and (2) both latency decrease and response-rate increase were enhanced by a second component stimulus which was similar to the first. The results are evaluated in terms of Amsel’s frustration theory and an analysis by Staddon which suggests that reinforcement inhibits responding. The data appear to support Staddon’s argument that rate increases and latency decreases following reinforcement omission are largely a function of an attenuation of the inhibitory influence of reinforcement, an effect that is enhanced by stimulus generalization. Accordingly, it is proposed that an animal’s response to reinforcement omission is determined by a stimulus complex that minimally includes the omission event and component cues. 相似文献
10.
Robert A. Rescorla 《Learning & behavior》1993,21(4):327-336
The associative changes that occur in extinction were investigated in four instrumental learning experiments. Experiment 1 used transfer based on a shared outcome to detect the continued presence of response-outcome (R-O) and stimulus-outcome (S-O) associations after a response had been nonreinforced in the presence of its controlling stimulus. Experiments 2–4 found that extinction resulted in the learning not to make a particular response in the presence of a particular stimulus, despite those continued R-0 and S-0 associations. These results suggest that extinction may superimpose upon those original outcome associations an inhibitory S-R association. 相似文献
11.
Acquisition, extinction, and transfer of facilitation were explored in a series of experiments with C57BL/6J mice. With a
procedure in which an auditory target was followed by food only in the presence of a visual facilitator, Experiments 1—4 showed
that the facilitator promoted magazine entries to the auditory target. This enhancement effect was eliminated by training
the facilitator as a conditioned inhibitor (Experiments 1 and 3B). Enhancement was also reduced by nonreinforced presentations
of the facilitator in a discrimination procedure (Experiment 1) and by simple nonreinforcement of the facilitator (Experiments
2, 3A, and 4). In contrast to the results obtained with a facilitator, simple nonreinforcement of an inhibitor, a visual cue
that had signaled when an auditory target would not be reinforced, did not reduce its ability to modulate responding to that
target (Experiment 4). However, both the facilitator and the inhibitor were found to transfer their modulatory effects to
other targets (Experiment 4). Finally, mice demonstrated no evidence of differential responding on a biconditional discrimination
procedure in which one auditory target (A1) was reinforced in the presence of one visual stimulus (L1) but not in the presence
of another (L2), and a different auditory target (A2) was reinforced in L2 but not in L1 (Experiment 5). The implications
of these results for analysis of the function of a facilitator are discussed. 相似文献
12.
Ruth M. Colwill 《Learning & behavior》2001,29(2):153-164
The effect of noncontingent outcomes on an instrumental response-outcome (R-O) association was examined in four experiments using transfer tests. In each experiment, rats were first given instrumental discrimination training designed to establish different stimuli as signals (S+s) for different outcomes. Transfer responses were subjected to different treatments across the experiments and then tested with the S+s. In Experiments 1 and 2, two transfer responses were both initially trained with two contingent outcomes. Then, each transfer response was subjected either to the addition of noncontingent presentations of one of those outcomes (Experiment 1) or to the replacement of one of the contingent outcomes with noncontingent presentations of that outcome (Experiment 2). Transfer tests revealed no significant difference in the ability of an S+ to promote performance of a transfer response based on their shared association with either the contingent or the noncontingent outcome. These results suggest that a response reinforced with two outcomes remains equally well associated with both of those outcomes despite prolonged exposure to noncontingent presentations of one of those outcomes. In Experiments 3 and 4, the possibility that the noncontingent schedules of reinforcement used in Experiments 1 and 2 might be capable of establishing an association between a response and its noncontingent outcome was examined. Transfer responses were trained with one contingent outcome and a different noncontingent outcome. Performance of these transfer responses was augmented more by presentations of an S+ trained with the contingent outcome than with the noncontingent outcome. These results confirm previous reports that instrumental responses are sensitive to outcome contingencies in acquisition and that noncontingent outcome presentations do not weaken previously established R-O associations. Several explanations are considered for the failure of subsequent noncontingent presentations of an outcome to reduce the strength of its association with the instrumental response. 相似文献
13.
In three experiments using rats, we examined the role of a discriminative stimulus (S) in governing the relation between a response (R) and an outcome (O) in an appetitive instrumental learning paradigm. In each experiment, we attempted to distinguish between a simple S-O association and a hierarchical relation in which S is associated with the R-O association. We used three variations on discriminative training procedures and three different assessment techniques-for revealing the hierarchical structure. In Experiment 1, we employed a training procedure in which S signaled a change in the R-O relation but no change in the likelihood of O. Although such an arrangement should not produce an excitatory S-O association, it nevertheless generated an S that controlled responding and transferred that control to other responses. In Experiment 2, we used a discrimination procedure in which two Ss each had the same two Rs and Os occur in their presence but each S signaled that a different R-O combination would be in effect. This design provided the opportunity for equivalent pairwise associations among S, R, and O but unique hierarchical relations. The subjects learned the hierarchical structure, as revealed by the specific depressive effect of a subsequent lithium-chloride-induced devaluation of O on responding only in the presence of the S in which that response had led to that outcome. In Experiment 3, one S signaled two different R-O outcomes. Then, two new stimuli were presented with the original S; the R-O relations were retained in the presence of one of the added stimuli but were rearranged in the presence of the other. The added S came to control less responding when it was redundant with respect to the R-O relations than when it was informative. Although all of the results were of modest size and each has an alternative interpretation, together they provide converging evidence for the hierarchical role of S in controlling an R-O association. 相似文献
14.
Robert A. Rescorla 《Learning & behavior》1997,25(1):99-107
In four experiments using rats, a Pavlovian conditioned stimulus (CS) was paired with a positive outcome, either pellets or liquid sucrose. That outcome was then either omitted altogether or replaced by another outcome. Although performance to the CS deteriorated only when the outcome was omitted, both procedures resulted in the CS’s ability to evoke greater responding after the passage of time. These results suggest that a similar outcome-independent depressive process develops when a Pavlovian CS is paired either with nonreinforcement or with a different outcome; that process then appears to dissipate with time. 相似文献
15.
Urcuioli PJ 《Learning & behavior》2005,33(1):1-21
The role of the reinforcer in instrumental discriminations has often been viewed as that of facilitating associative learning
between a reinforced response and the discriminative stimulus that occasions it. The differential-outcome paradigm introduced
by Trapold (1970), however, has provided compelling evidence that reinforcers are also part of what is learned in discrimination
tasks. Specifically, when the availability of different reinforcing outcomes is signaled by different discriminative stimuli,
the conditioned anticipation of those outcomes can provide another source of stimulus control over responding. This article
reviews how such control develops and how it can be revealed, its impact on behavior, and different possible mechanisms that
could mediate the behavioral effects. The main conclusion is that differential-outcome effects are almost entirely explicable
in terms of the cue properties of outcome expectancies—namely, that conditioned expectancies acquire discriminative control
just like any other discriminative or conditional stimulus in instrumental learning. 相似文献
16.
In each of two experiments, rats were trained to press the lever in a Skinner box, food reinforcement being available on a variable-interval 60-sec schedule (VI 60). There followed an “exposure phase” for which the levers were removed from the boxes, and then a final test with the levers replaced to assess the effects of the intervening treatment on instrumental responding. Experiment 1 showed that simple exposure to the box reduced the vigor of instrumental performance in comparison with a condition in which food was made available during the exposure phase. Animals which received no exposure treatment also showed a relatively high rate of response. Experiment 2 demonstrated that an exposure treatment in which the occurrence of food is signaled by a light stimulus also leads to a decline in instrumental responding. These results are held to support the notion that associations between the context and the reinforcer serve to energize appetitive instrumental behavior. 相似文献
17.
Steven J. Haggbloom 《Learning & behavior》1983,11(3):367-372
In two experiments, rats were trained on a successive go/no-go discrimination problem in the runway in which the positive (S+) and negative (S?) discriminanda were differentiated by the presence or absence of a distinctive feature. The feature in Experiment 1 was a series of flashing lights over the runway. In Experiment 2, the feature was a pretrial reinforcement (Phase 1), or pretrial reinforcement versus pretrial nonreinforcement (Phase 2). The feature signaled S+ trials in feature-positive (FP) groups and S? trials in feature-negative (FN) groups. The original discrimination was reversed in Phase 2 of both experiments. With the exception of the pretrial nonreinforcement groups in Experiment 2, there was an asymmetry in discrimination learning in both phases of both experiments favoring superior discrimination learning by FN subjects over FP subjects, a feature-negative effect. Implications of the results for an information processing account of asymmetries in learning feature discriminations are discussed. 相似文献
18.
In two experiments, rats solved two concurrent discrimination problems in which one stimulus (i.e., a facilitator) signaled the reinforcement of another stimulus (i.e., a target). Then a transfer test assessed the capacity of facilitators trained in one problem to promote responding to targets trained in the other. Experiment 1 found that a facilitator promoted as much responding to such a transfer target as to the target with which it was originally trained. Transfer was not obtained with a pseudofacilitator that was uninformative, in training, about the reinforcement of its target. Experiment 2 manipulated the stimulus modality of the targets and facilitators. Its results indicated that transfer performance was not due to generalization between training and transfer targets or facilitators. These results parallel those from comparable autoshaping paradigms with pigeons, and they agree with the view that facilitators promote responding by lowering the threshold for activation of the US representation. 相似文献
19.
Two experiments with goldfish were performed to investigate the role of stimulus-reinforcer vs. response-reinforcer relationships in omission training and the role of stimulus localizability in a positive behavioral contrast paradigm. The directed behavior of fish, like that of pigeons and rats in other studies, was greatly influenced by positive stimulus-reinforcer correlations, as evidenced by maintained contacts of a signal for food, even though such responses terminated the signal and cancelled reinforcement delivery. Goldfish exhibited positive behavioral contrast when the signals for reinforcement and nonreinforcement were displayed directly on the response key, but no contrast was observed when variations in a diffuse houselight stimulus were used as signals for reinforcement or nonreinforcement. Analysis of sequential-trial data yielded effects analogous to Pavlovian positive and negative induction. Theoretical and methodological problems were briefly considered. 相似文献
20.
Two experiments examined the effects of extended training on the development of response-reinforcer associations. Rats were trained by using various food reinforcers to make multiple instrumental responses. Subsequently, those reinforcers were devalued by being paired with a toxin. The presence of response-reinforcer associations was inferred from the decrease in the likelihood of a response following devaluation of its reinforcer. Such response-reinforcer associations are known to contribute to performance after moderate amounts of training. These experiments addressed the question of whether the contribution of those associations remains constant, increases, or decreases with more extended training. Experiment 1 found that even after a response had been extensively trained with one reinforcer, the substitution of a new reinforcer produced new associations between the response and that new reinforcer. After extended training, a response continued to acquire new associations with a reinforcer, as indexed by the impact of a devaluation procedure. Experiment 2 directly compared the contribution of reinforcers used extensively and moderately with the same response. It found that devaluation of the extensively used reinforcer more effectively reduced performance of the response, suggesting that the associations formed with additional training contribute to performance of the response. These experiments indicate that the contribution of response-reinforcer associations does not decrease but, instead, continues to grow throughout the course of extended instrumental training. 相似文献